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COMPUTER RESOURCE PROPORTIONAL 
UTIUZATION AND RESPONSE TIME 
SCHEDUUNG 

BACKGROUND OF THE INVENTION 

1. Technical Field 

The present iovention relates generally to scheduling 
resources in a computer system. 

2. Description of the Related Art 

The general goal of resource scheduling is to order the use 
of or access to the resource by tasks to meet a set of 
system-level and/or user-level objectives. For example, 
these objectives may include resource utilization objectives 
among different types (i.e. classes) of tasks, satisfying 
wait/response time objectives among different task classes, 
providing predictable (i.e. low variance) performance within 
and across task classes, allocating resources in a fair manner, 
and favoring tasks with short resource usage/holding time 
over tasks with long usage/holding time. 

Many of these scheduling goals are often in conflict, thus 
making resource scheduling a complex design problem. 
Given this complexity, many scheduling algorithms have 
been designed to meet only a subset of the above objectives. 
While these policies are typically effective within their 
intended domains, they often have limited success, or they 
do not perform well at all in system environments with 
different requirements. Indeed, it is not unusual to find 
systems in which the scheduling and dispatching parameters 
must be manually adjusted in response to large changes in 
customer workload. This requirement gives rise to undesir- 
able complexity and overhead. Thus, in addition to support- 
ing multiple diverse scheduling objectives, a principal 
design challenge is to provide effective control over resource 
allocation to achieve the desired performance requirements 
for these simultaneous objectives. 

The present invention addresses these problems. 

SUMMARY OF THE INVENTION 

It is a primary object of the invention to achieve propor- 
tional usage and response time performance objectives for 
the use of or the access to a resource within a unified and 
integrated scheduling mechanism of a computer system. 

It is a further object of the invention to provide both 
"usage" and "response" mode scheduling of a computer 
resource, for example, a processor, wherein one mode is 
effected within the confines of a job class that has been 
constrained by the other mode. 

It is still another object to allow for a system to dynami- 
cally adjust to changes in workload requirements for a 
resource without manual intervention. 

It is another object of this invention to provide general, 
flexible and adaptive control over resource allocation to 
achieve diverse scheduling objectives and performance 
requirements. 

It is another object of the invention to schedule a resource 
in a computer using a hierarchical scheme that supports the 
combination of "usage" and "response" mode objectives in 
a general and flexible manner, and to as many levels as 
desired. 

Another object of the invention is to schedule a resource 
using general time-based functions that are driven by 
resource utihzation and response time objectives, an adap- 
tive feedback mechanism, and a notion of resource requester 
classes. 
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It is yet another object of the invention to schedule a 
computer resource for "classes" of requests, wherein a class 
consists of a group of requesters that have the same perfor- 
mance objective in relation to other classes of requesters in 
5 the system. 

Still another object of the invention is to provide a job 
class scheduler that includes a migration mechanism asso- 
ciated with each class such that a given job that "taxes" the 
resource is migrated to a lower priority job class upon 
meeting a set of tisage criteria. 

A still further object is to use the unified and integrated 
methodology of the invention to address and solve known 
scheduhng problems that have not been adequately solved 
by the prior art. 

]5 According to the invention, resource scheduhng is per- 
formed for jobs in job classes within a unified framework 
according to "time-functions." Each job class has a "time- 
function" associated with it, the value of which dynamically 
controls when the job class is selected for scheduling as the 

20 resource becomes available. A time-function can be any 
function of "time" in the most general sense, such as a 
formula that determines the certain values returned by the 
function given values of a set of variables (or input 
parameters). The "time" parameter can be any measure of 

25 time with respect to the resource and other resources that are 
used to evaluate the per-class time-function value. In the 
preferred operation, the time -functions can be based on a 
general "usage" mode, in which the time parameter is any 
measure of the use of the resource or set of resources by the 

30 class, a general "response" mode, in which the time param- 
eter is any measure of the waiting for the resource or set of 
resources by the class, or any combination of such modes. 
Any general order relation, or choice function, can then be 
used to determine which class should be selected based on 

35 the per-class timc-fiinction values. Example choice func- 
tions include the maximum and minimum operator, but in 
the preferred operation, the choice function is typically the 
operator that chooses the minimum value among the time- 
function values being considered. Once a job class is 

40 selected for scheduling, a job within that class is provided to 
the resource for execution. 

According to another feature of the inventive scheduling 
framework, the job classes vying for a resource's attention 
are arranged in a general "hierarchy." The time- functions 

45 associated with the classes of each level of the hierarchy 
have the same "mode." However, each mode is preferably of 
equal and consistent viability. Moreover, the system admin- 
istrator and/or user can arrange the job classes and the 
time-function modes at each level in any manner desired, 

50 and for as many levels as desired. For example, the lop level 
of the hierarchy may consist of several job classes among 
which the resource is allocated to maintain a set of propor- 
tional utilization goals. Each of these classes has a usage- 
mode time-function associated with it that dynamically 

55 controls which class is selected for scheduling when the 
resource becomes available. At the next level of the 
hierarchy, each of the top-level classes may comprise several 
subclasses among which the resource is allocated to main- 
tain a set of response time objectives. Each of these sub- 

60 classes has a response -mode time -function associated with it 
that dynamically controls which subclass is selected for 
scheduhng when its parent class is selected at the top level 
of the hierarchy. This hierarchical scheduling framework is 
completely general and can be recursively defined to as 

65 many levels as necessary/desired. 

According to another feature of the invention, the coUec- 
tion of job classes at each level of the scheduling hierarchy 
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can be partitioned into "groups" of job classes with the first FIG. 6 is a flowchart illustrating a Class Update routine; 

group having absolute priority over aU other groups, in the FIG. 7 is a flowchart illustrating a Job Enter/Return 

sense that job classes in other groups are not considered for routine; 

access to the resource unless aQ classes in the first group are FIG. 8 is a flowchart illustrating a History Update routine; 

empty. The second job class group has absolute priority over S and 

all other groups except the first job class group, and a similar FIGS. 9A-9B are graphs of illustrative usage and 

absolute priority ordering is defined for the remaining job response mode scheduling objectives showing how job 

class groups. The time-functions for the classes in each classes are scheduled according to the present invention, 

group have similar forms in the sense that they are either DETAILED DESCRIPTION OF THE 

constant (i.e they do not vary with "time"), or they vary lO PREFERRED EMBODIMENT 
dynamically according to either "usage" or "response" 

mode. For example, a first job class group may comprise According to the present invention, a "class" generaUy 

high-priority short system tasks, interactive work (wherein consists of a group of requesters that have the same perfor- 

only a smaU amount of resource usage occurs between mance objectives in relation to other classes of requesters in 

substantial idle periods), and jobs with real-time contraints is system. In some instances, a class has only one requester, 

that have absolute priority over other classes of work. ^ ^^d herein, a requester is often referred to as a "job," 

In one preferred embodiment, it is preferably intended to ^^^^^ VT^"^ '^'^'''^^ ^^^u ' '^'f ^ a resource in a 

1 •.*L • u 1 • • -1 4 1 I i:*u given schedulmg interval In other words, in the context of 

exploit the job class grouping primanly at the top level of the * , . • ^ • . . 

hierarchy at any level or <i,mbinatioa of levels of the ^ computer sy«em, a job ^ analogous to a requester. Thtjs, 

t. ' t jT ^i. 4- • 1 J 1 each lob class typically has an associated number of lobs 

heirarchy. However, the present invention mcludes general ^ t • • , u, ij>, u x . . 

c ' u ^ * *u '*u 4U u J 1* desmng to access or hold the resource. Jobs may be 

use of job class groups together with the scheduhne ■ j * ■ i i_ ^ . .i 

, . t o r o o assigned to a given class by the system, by the user, or a 

combination of both. Job classes, likewise, may be assigned 

Several adaptive feedback mechanisms arc preferably a system or user. As used herein, a "job class" may 

feature of the inventive scheduling framework. One such include one or more "jobs " 

technique involves adaptively adjusting the time-functions " ^ representative embodiment, the resource is a proces- 

with changes in the resource utUization, tnui of jobs or any „f ^ ^„ „^ ^ J^^^ processor, as is 

other trigger or event Another technique involves migratmg ^ ^ ^^^^^^ ^^^^^ of computational cycles 

jobs from one class to another m the hierarchy as u^ge of ^j^^ ^ j^j^^^^^, . ^^^.^ ^^^^ 

the resource, or set of resources, exceeds limits specified by ^ processor. Hie present invention addresses the problem 

a system admimstrator and/or a user, and then returning a job scheduling the processor for various classes of requests in 

0 lis ongmaung class if U becomes idle for a sufSc.enUy ^ maximizes its efEcient use yet still meets a set of 

long penod of tmic, as pre-spcaficd by the system admm- st,^.i,vel and/or user-level resource consumption objec- 

istrator or user. ,j^gs 

The foregoing has outlined some of the more perUnent 35 According to the invention, consumption objectives are 

objects and features of the present invention. These objects generally of two types: usage and response. Neither usage 

should be construed to be merely illustrative of some of the j^^t response mode is favored in the unified and integrated 

more prominent features and applications of the invention. nj^thod of the invention that is described below and, as will 

Many other beneficial results can be attained by applying the be seen, this methodology has been designed to fully exploit 

disclosed invention in a different manner or modifying the functional advantages of each mode, and any desired 

invention as wiU be described. Accordingly, other objects combination of these modes. The result is a very robust 

and a fliller understanding of the invention may be had by scheduling mechanism that facilitates extremely "fine" con- 

refernng to the foUowing Detailed Description of the Pre- resource scheduling. In "usage" mode, the resource 

ferred Embodiment. is proportionally allocated to job classes, or to a set of job 

BRIEF DESCRIPTION OF THE DRAWINGS « "^""^ ^ '^^^-^^''<'\ implementation), based on a pro- 

portional utilization (or Usage ) objective defined for these 

For a more complete understanding of the present inven- classes (or subclasses). In the preferred embodiment of the 

tion and the advantages thereof, reference should be made to invention, as will be seen, the proportional allocation is also 

the following Detailed Description taken in connection with based on an accumulated utilization (in a history-based- 

ihe accompanying drawings in which: so average sense) of the resource by each job class (or sub- 

FIG. 1 is a representative hierarchy of job classes vying grouping of job classes). Thus, in the case of a single level 

for access to a given resource in a computer or computer implementation involving a group of job classes, class 1 (for 

system; example) may receives 60% of the resource whereas class 2 

FIG.' 2 is an exemplary hierarchy wherein proportional '^"^'''^ ""^ tesomcc In "response" mode the 

usage and response time allocations are suppUed for a pair « '^^'"'^^ is allocated to job classes, or to a set of job 

of subgroups that include dynamicaUy varying lime-based subclasses in a multi-level miplementation), to satisfy a 

functions according to the presem invenuon; proportional response time objective defined for these 

.. . . n . classes or to mmimize a weighted sum of a function of the 

RG. 3A lUustrates the basic operation of the scheduler ^^^p^^^^ ^^^^^^ r^^^^ ^^^^^^^ ^^.^ 

mechanism of this invention N^th the mechanism supported objecUve may dictate that the mean response times of 

withm the operatmg system of a computer; ^j^^^^ 1, 2 and 3 are to be maintained in the ratio 3:2:1 (or 

FIG. 3B iUustraies the basic operation of the scheduler as close as is feasible). The particular proportional usage 

mechanism when the mechanism is supported as an adjunct objective or the proportional (or weighted sum) response 

to the operating system; time objcctivc(s) may be set by a user, by a system operator, 

FIG. 4 is a flowchart illustrating a Group Selection routine 55 or by some other means (manual or autonomous), 

of the scheduling mechanism; The present invention may be implemented in a computer 

FIG. 5 is a flowchart illustrating a Qass Selection routine; or computer system, but this is not a requirement. As a 
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represeatative example of how usage and responses can be Moreover, as further illustrated in FIG. 1, a particular job 

used, the following is illustrative. class may be recursively defined into subclasses to as many 

For usage mode, a computer system often has a primary levels as desired. Thus, job class i (whether response or 

core of work with some batch processing work that is to be usage mode is selected) may have associated therewith 

performed around the primary core. The problem often s subclasses i^ through i^^^,-, and a particular subclass iy may 

encountered is that the batch work gets starved by the core likewise have associated therewith (whether response or 

work, and this is not desired. Therefore, you might want to usage mode is selected) a still further set of subclasses, 'j^ 

ensure that the batch work gets at least 20% of the resource. through 'jj^., and so od. llius, it is a feature of the present 

Another example is where two departments share the com- invention to provide for each class entry to be recursively 

puler and you want to proportionally aUocate the resource defined. This provides a significant advantage in aUowing 

among the two departments m a non-equal and controllable ^^^^ ^^^^^ ^f scheduling control to meet a greater 

way. For response mode, it is often important in various ^^riety of user/system performance objectives, 

computer systems (e.g., transaction processing systems) to ^ i -h . . j . r r 

control the mean and variance of response times among a set . ^ '""f f ^ advan ageous feature of the 

of job classes. In this case, it can be important to have the T*"^"'?- ^" P"''^"!^'' "me-functions assoaaled with 

« • * » c • u • 1 « •» • 1- 1 -^u *u *• ■'^ the job classes m each group m the hierarchy may be either 

"prionty of a job in class "i mcrease hnearly with the time , • „ . l 

J „• f *L T-u 1 f.u- 1* constant or dynamic . Thus, within each group, the order 

It spends waitmg for the resource. The slope of this linear . uu ui • \*u j^iji- 

r ^. J J 1 J •* • * wu m which job classes gain access to the resource is defined by 

function depends upon the class and it IS used to control the . j/-.- l^l-l l 

*• *u * u 1 w u 1 ^ time-based functions, each of which may be constant or 

response times that each class gets (in an absolute sense, or , . . ' . ^ 

relative to the other classes^ dynamically varying accordmg to some measure of time. 

^ 1- ^ When constant time-based functions are used, each job class 

The use of Ume-functions unifies the support of diver^ ^ time-function value that remains fixed with time. 

«^ u objectives wUlun a smgle scheduling method. dynamically varying time-based functions are used. 

Which job class IS selected for schedulmg when the resource * a, ^ • u i n • -.u 

. , 1 . « , t . the time-runction value of a lob class generally vanes with 

becomes available is detetmmed dynamically by the tmie- ^ ^^ ^^^^^^ advantages of this 

function associated with each class a that epoch. Tune- ^5 ^ ^^^^^ described in detail below 

functions can be any function of time in the most general , • , ■ , 

sense, where any measure of time with respect to the Further, associated with each set of classes or subclasses 

resource and other resources can be used to evaluate the I' sub-subclasses, etc (as the case may be) is a bit mask 12. 

time-function values (sometimes referred to as «TF value"). mask mcludes a bit (assigned a 0 or 1 value) associated 

As used in the preferred embodiment, but not restricted to 30 "^^^ ^ ^^'^"^^^ ^^f^^' ^"'^'r^^ or sub-subclass, etc. (as the 

this use, "time" is measured in two general ways. For case may be). The bit provides an indication of whether the 

example, time is any measure of the use of the resource or respective class, subclass or sub-subclass, etc., is empty and 

setofresourcesbytheclassofrequesters(i.e.jobs),inwhich ^^^^^f^ processing. This ophmizcs 

case the time-function is said to be in "usage" mode, and/or ^^^^/^ scheduler routines as wiU be seen below As 

time is any measure of the waiUng for the resource or set of 35 ^^'^^^^^^ ^° ^ ^^^^^ of pointers may be used, 

resources by the class of requesters, in which case the Although not illustrated in detail in FIG. 1, each job 

time-function is said to be in "response" mode. Without loss within a particular job class is also assigned a job queue, 

of generality, it is preferably assumed that the job class "i" which maintains a set of jobs from the corresponding class 

is favored over job class j, for i<j, under equal conditions; i.e that are waiting to acquire the resource. The queue may be 

the time-function for class i yields a value greater than or 40 ^ convenient database construct, such as a linked list, 

equal to the time -function for class j when both are given the The hierarchy of groups, classes and subclasses presented 

same set of input parameter values. Class i is referred to as here represents a very powerful framework to organize jobs 

a "higher class" than class j and, conversely, class j is a such that jobs are scheduled to have access to resources to 

"lower class" than class i. meet their performance objectives. Job classifications, their 

In the preferred embodiment, job classes are arranged in 45 performance objectives, and thus the appropriate job class 

a hierarchy. FIG. 1 illustrates a general case of the hierar- hierarchy, are set by users or system administrators who 

chical scheme 10. In this example, an entire group of job have the authorities and responsibilities to do so. With the 

classes 1 through K is partitioned into "N" different groups time-function history scheduling, the performance objcc- 

(labeled 1-N), with each group having absolute priority over lives can be hierarchical and/or any combination of propor- 

the job classes in the next group in the hierarchy. Thus, a job 50 lional usage and response time in addition to the constant 

belonging to a class in group 2 can be executed only if there time groups. A specific case of the hierarchy is illustrated in 

are no runable jobs from group 1 present in the system. FIG. 2. It should be appreciated that the hierarchy of FIG. 2 

Similarly, jobs in group 2 have absolute priority over those is exemplary and is shown merely to describe the inventive 

in group 3, and so on. In a representative system, job classes feamres with respect to a particular example. It should not 

in the highest priority group, namely group 1, are used to do ss be construed to limit the present invention to the particular 

low level system work having high priority, such as oper- scheduUng objective(s) illustrated. 

ating system tasks. User level tasks (such as transaction In FIG, 2, three (3) job class groups A, B and C are 

processing) have relaUvely lower priority and therefore provided. At least some of the job classes in group B (for 

might be placed in group 2 (or perhaps lower). The lowest reasons that will become evident) have subclasses associated 

priority tasks, such as those that absorb excess cycle time 60 therewith as illustrated. Job classes in group A have asso- 

(e.g., system back-up or other background processing) might dated therewith "constant" time-based funcdons, which 

be relegated to the lowest group N. leads to a fixed-priority scheme to differentiate among the 

According to the invention, each group has one or more job classes therein. With constant time-functions, jobs in the 

job classes associated therewith. Thus, as illustrated, group second class within the group are scheduled only if there are 

1 has job classes I through Lj, group 2 has job classes 65 no jobs in the first class of the group, jobs in the third class 

{Li+1} through {Lj+Lj} and so on through group N, which within the group are scheduled only if there are no jobs in 

has job classes {Li+L2+' • • through {Li+. . . L^}. the first and second class of the group, and so on. Within job 
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class group A, there may be different types of tasks. Thus, class based on these values is recursively applied through 

for example, there are short "system" tasks that need to be the appropriate parts of the scheduling hierarchy, 

given priority over all other tasks (perhaps with differences ^ ^Iso seen in FIG. 2, in the representative example, 

in priority among different job classes). These tasks are ^^^^^^^ fixed-priority scheme is used for the job classes in 

developed by those building the system m the first instance s the third group C by assigning a constant time-based func 

and thus are short system tasks by definition and oon- ^^^^ ^j^^ ^^^^^^ ^ ^ (primarily) 

stniction In addition, there are real-Urne user (as opposed to ^^^^^^ system-level background work. A non-empty 

system) tasks that are often next in Ime for access to the , ^ i j * * a *u * ut -c 

^ ujij j-.cj set C can lead to starvation and other system problems if It 

resource. Such taste ar« oten scheduled ^^ozdingio^ fixed ^ ^"^^ ^ 

pnonty scheme after system t^ are handled but often ^^^^.^ylU^^ disabled (by setting its size to 0) or only 

before other user tasks are handled. Job class group A may j. * i j *u u- r *u * i ■ 

^ , . , i_ - i_ J / J used by tasks under the sponsorship of other tasks m groups 

further mclude interactive user tasks, which are defined as a . ^ ^ . j/ r-™ u ™* 

^ r . ' 1 . • 1 u . Aor B. Groups A and/or C may be empty groups, 

small amount of resource usage between relatively substan- ^ ' r j o r 

tial periods of idleness. There may be advantages to giving PI^, 2 thus iUustrates how the scheduling mechanism 

these interactive tasks absolute priority over other user tasks supports the combination of usage and response modes 

(which may, therefore, fall into job class group B as will be ^^^in or across different hierarchical levels m a very 

discussed). The fixed priority scheme provided by constant S^^^^^ flexible manner. For example, a user or the 

time-funcUons can support these (and other) scheduling system may select usage mode or response mode. Thus, m 

requirements of different types of tasks with respect of ^ one-level implementation, a system value can be set to 

resources of a computer or computer system. ,n ^^^"^^ between either the usage mode or response mode. For 

Thus, within the context of job class group A in FIG. 2, ^ ^^^'l^?! implementation, a system can schedule the 

there are system tasks with priority over real-time tasks with '^^"^'^^ ^^^^.^ ^^S^^^^f ""''^f ^^^^ ^=^P°°^) 

priority over interactive tasks, all of which are in the same mode. Once a certam class is selected to receive the reso^^^ 

group. TTie fixed priority scheme (via the constant time- ^ P^/^^^^^^ ^^^^'^^^ ^^i^^ 

functions) within the group is used to order the access of the <^^nbe based on response (or usage) mode. FIG. 2 shows the 

resource by the different types of tasks within the group. multi-level unplementation with job classes in group B 

. , .11 ■ ^ V J ii • r i_i allocated via usage mode, with mdividual subclasses within 

Adynamicaily vatymg tunc-basea tunction is pretcraWy ^ .^^ ^j^^ 

via response mode. 

associated with each job class in the second group B. In this ^ 

illustrative example, classes B.l through B.L^ are subject to ^ migration mechanism may be associated with each job 

a usage mode objective {40%, 20%, . , . 5%}, and the 30 Particular, a job of one class may be migrated to 

individual classes B.l, B.2, ... are subject to a response ^^^^"^ ^^^^^ ^^^^^ upon its exceeding a set of criteria based 

mode objective. Thus, subclasses of B.l have a response ^n the job's use of resources. The distance of how far the 

mode objective {10:3: ... 1} and subclasses of B.2 have a ^^sk is migrated is defined by a migration rale associated 

response mode objective (8:4: ... 1}. The individual with the job class. A class to which a job is imtially assigned 

parameters of each objective (whether usage or response 3s ^ "^^^^ ^""^ J^*'' U"^^"* "^'^^ circumstances, 

mode) are, of course, individually selectable and, if desired, * J^b class (and/or job) may be moved higher up the 

dynamically adjustable. Altemadvely, such parameters may hierarchy to a higher class. An example of this is set forth 

be pre-assigned at some default value. Adjustment of the ^clow in addrcssmg the problem of "priority inversion.^' 

parameter values comprising the particular objective may Preferably, job classes in group B are considered only 

occur upon a given event, upon the expiration of a certain 40 when there is no ready work in group A, and group C is 

time, through use of an adaptive feedback that adjusts the considered only when there is no ready work in A and B. 

weights dynamically, through a knowledge-based expert This hierarchical scheme is used together with the migration 

system, or via some other known technique. Thus, for mechanism associated with each dass, which drops a job to 

example, one "event" might be temporal-based such as a lower class (within or beyond its current group ) upon 

arrival at a particular time of day; alternatively, the event 45 exceeding the resource criteria associated with the class, 

may be load-based such as a trigger that sets a new objective Thus, in one illustrative embodiment, a job enters group B 

when a given threshold of system usage is reached. either because its base class is contained in B, or because the 

Of course, the fact that usage mode is implemented at the job is (eventually) migrated into one of the job classes of 

class level and response mode is implemented at the sub- g^up B upon exceeding the migration criteria associated 

class level is merely illustrative. As noted above, neither 50 with its group A classes. In this embodiment, jobs enter 

usage nor response mode is favored in the implementation. classes in A and C because their base classes are in A and C, 

Both are equally viable and avaUable for any particular respectively. In addition, preferably a job is returned to its 

dynamic time-fiinction(s). In general, the per-class tune- base class upon becoming idle for a substantial period of 

functions may have any functional form. In the preferred ^me. 

embodiment, the absolute value of each per-class time- 55 FIGS. 3A and 3B are simplified block diagrams of how 

function is monotonically non-decreasing (meaning that the the scheduler mechanism operates within a computer or 

time-function value at lime "I" is always greater than or computer system to provide a resource with jobs from the 

equal to the time-function value at time t' for all t' greater job classes. In this example, resource 14 is the processor or 

than t). This imphes that (among other things), job assign- other processing element(s) of the system 40. Computer 

mcnt from a given job class that has been provided access to 60 system 40 includes an operating system 42 supported in 

the resource preferably occurs on a first come, first serve memory 44. In the embodiment of FIG. 3A, the scheduler 

basis, as is desirable to provide predictable performance mechanism 46 (sometimes referred to as a dispatcher) is 

within and across job classes. Any general choice function implemented as an operating system utility. In the embodi- 

can then be used to determine which job class within group mcnt of FIG. 3B, the scheduler is a software application 

B should be selected based on the per-class time-function 65 executed by the operating system 42. In either case, the 

values. Once a particular class is chosen, this procedure of scheduler includes a job queue 48 associated with each job 

evaluating per-class time-function values and choosing a class. The basic function of the scheduler mechanism is to 
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obtain jobs firom the job queues and provide them to the 
resource for execution. As illustrated in the FIG. 3B 
embodiment, the resource may include a wait queue 45 that 
holds jobs scheduled for execution by the resource. The 
scheduler mechanism obtains jobs from the job queues and 
places them in the wait queue for execution by the resource. 
The wait queue is not required in the FIG. 3A embodiment. 

The various operational logic of the scheduling mecha- 
nism are now described in the following preferred embodi- 
ment. The Group Selection and Class Selection routines 
(FIGS. 4-5) are used to assign the available resource to a job 
from an appropriate job class or subclass within a selected 
group. After a job from a particular class is selected in such 
manner, the Update routine (FIG. 6) recalculates the 
dynamic time-function value for the job class in preparation 
for the next selection cycle. The History Update (FIG. 8) 
routine calculates the time-function values and maintains 
necessary data to ensure all the job classes would meet their 
performance objectives (in contrast to a single job class 
maneuver in the Update routine). The Job Enter/Return 
routine (FIG. 7) provide a possible migration mechanism to 
penalize jobs that use resources beyond the intended limits. 

FIG. 4 is a flowchart illustrating the Group Selection 
routine. This process is used to select a particular group for 
processing. It begins at step 50 by finding the first non- 
empty class in the hierarchy. To this end, the bit mask for the 
hierarchy is searched and job classes associated with "0** 
entries in the mask are ignored for processing efficiency. At 
step 52, a test is performed to determine if a first non-empty 
class has been found. If not, the routine exits at step 54, If 
the outcome of the test at step 52 is positive, the routine 
continues at step 56 to test whether the job class belongs to 
a group having djnoamic time-functions. If not, then the job 
class belongs to a group having constant time -functions. In 
the latter case, the routine continues with step 58 to select a 
job from the class. This is preferably the job within that class 
which has been waiting the longest to use the resource. The 
routine then exits. If the outcome of the test at step 56 is 
positive, the routine continues at step 60 to call a Class 
Selection routine. 

The Class Selection routine is illustrated in the flowchart 
of FIG. 5. This routine is reciursively applied to the hierarchy 
as needed for the dynamic time -function groups. Since the 
time-function values for each job class or subclass change 
over time and at different proportional ratios, the Class 
Selection routine compares all the, time-function values of 
all non-empty classes within a group before making the 
selection. It begins at step 62 by initializing temporary 
variables: "save_TF_value" (to value TF[I]), "save_ 
class_index" (to value I) and current„class_index (to value 

I). At step 64, the current_class index is incremented. The 

routine then continues at step 66 to test whether all classes 
have been evaluated. If not, a test is performed at step 68 to 
determine if the class for the current_class__index is empty 
(which, as noted above, can be done using the bit mask). If 
the outcome of the test at step 68 is positive, the routine 
cycles back to step 64 and increments the current_class_ 
index. If the outcome of the test at step 68 is negative, 
however, a lest is performed at step 70 to determine whether 
TF[current_classindex] is less than save_TF_value. If the 
outcome of the lest at step 70 is negative, the routine cycles 
back to step 64 and the current_class_Jndex is incremented. 
If, however, the outcome of the test at step 70 is positive, the 
routine continues at step 72 and sets save_TF_value=TF 
[current_class_index] and save_class_index-current_ 
class_Jndex and then returns to step 64. Alternatively, if the 
outcome of the test at step 66 is positive, indicating that all 
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classes have been checked, the routine branches to step 74 
to select a job from the job class of save_class_index. At 
step 76, a test is then performed to determine if the job class 
selected is associated with response mode objectives. If not, 

5 the routine exits at step 78. If, however, the job class is 
associated with response mode, a Class Update routine is 
called at step 80. 

The Class Update routine is illustrated in FIG. 6. This 
routine "prepares" a next job in the class to be selected 

10 during a next iteration. In the context of usage mode, step 80 
is reached after adding the resource usage (from the job that 
just finished executing) to a cumulative usage for the job. 
TXirning to the flowchart, the routine begins at step 82 by 
testing whether the class at issue is in usage mode. If so, the 

]5 routine continues at step 84 to update cumulative usage by 
last class i resource usage and setting TF[i] to a new value 
using the following (equation (1)): 

time-function-value=function (cumulative usage, weight) 
where the weight for the job class is a parameter value in the 

20 particular usage time objective. The above function ensures 
that each job class will obtain its appropriate shares of 
resource usage while the \isage accumulations grow at 
different rates. After step 84, the routine ends. If the outcome 
of the test at step 82 is negative, however, the routine 

25 continues at step 88 to set TF[I] using the following equation 
(2) for the next job on the run queue for class i: 

time-function-value=function (waiting time, weight) 
where the waiting time reflects how long the job class has 
been waiting for the resource and the weight for the job class 

30 is a parameter determined by the response lime objective. 
After step 88, the routine exits. 

FIG. 7 illustrates a Job Enter/Rctum routine that is used 
to place a particular job in a job queue initially or following 
its execution by the resource. The routine begins at step 90 

35 to determine if the job of class_index has been idle longer 
than some pre-defined idlc_limit. If so, class_Jnd6x is set 
equal to base_class in step 92. The job is then placed on the 
job queue of class_Jndex at step 94 and the routine ends. If 
the outcome of the test at step 90 is negative, the routine 

40 continues by testing at step 96 to determine whether job 
cumulative resource usage is greater than a limit that is set 
for jobs in the class. If not, the routine branches to step 94. 
If, however, the outcome of the test at step 96 is positive, the 
routine continues at step 98 and sets class_index equal to a 

45 target migration class. The routine then continues with step 
94 as previously described. Steps 92 and 98 thus implement 
job migration across the hierarchy. 

FIG. 8 illustrates a History Update routine that will 
recalculate the time-fimction values for each job class that 

50 has a dynamic time- function. This routine begins at step 100, 
At step 102, a test is made to determine whether class i is 
associated with usage mode. If so, the routine continues at 
step 104 to apply an aging function (if necessary) to the 
cumulative usage for class i. The routine then exits. An 

55 example for the aging scheme is multiplying TF[i] by a 
constant (less than 1). The aging function provides several 
advantages. If a class of jobs has not been using the resource 
for some period of time (e.g., the last 24 hours), it might 
monopolize the resource in order to make up for "lost" time. 

60 The aging function prevents such biasing. 

Alternatively, if the outcome of the test at step 102 is 
negative, then response mode is in effect. Then, the routine 
continues at step 106, updating TF[i] using equation (2) 
described above and the routine ends. At the end of this 

65 routine, all the job classes in the response mode will have 
their time -function values recalculated with respect to a new 
scheduUng epoch (thus, with new waiting time). The History 
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Update routine can be used at every selection cycle. from class A for processing, since higher classes are pref- 

However, this routine is used at a fixed time interval, which erably chosen to arbitrate ties. Upon completion, the time- 

is user/system definable. For efi&ciency reasons, the latter function value for class A will be updated to (i.e 0 plus 1 

approach is preferred. unit multiplied by V4). The next scheduling decision will 

It should be appreciated that equation (1) is thus executed 5 select the first job from class B for processing, since class 

when the scheduler operates in usage mode (to allocate B's time-function value is 0. Upon completion of this job, 

according to a usage lime objective) and that equation (2) is the time-function value for class B will be updated to 1 (i.e 

executed when the scheduler operates in response mode (to 0 plus 1 unit multiplied by 1). Continuing in this maimer, the 

allocate according to a response objective). Within any next four scheduling decisions will select a job firom class A 

particular level (whether class, subclass, sub-subclass, etc.), lO (since ties are won by class A), resulting in a time-function 

preferably only one type of mode (either response or usage) value of 1 .25 (0.25 plus 4 units multiplied by Vi) for class A. 

is implemented. In usage mode, the time-function value for The next scheduling decision will select a job from class B, 

each class is preferably determined by the accumulated resulting in a time-function value of 2 (1 plus 1 unit 

usage by all the jobs in the class. In response mode, the multiplied by 1). This continues as long as there are jobs in 

time -function value is preferably determined by the waiting 15 the job queue of both classes, subject to history updates. A 

time of the oldest job in the class. It should be noted that the graph of this operation is shown in FIG. 9A. 
use of the "oldest" job follows directly from the use of For a representative example of scheduling under 

monotonically non-decreasing response mode time- response-mode time-functions, consider the case where 

functions. If the time-functions were not non-decreasing, three job classes A;B:C (or subclasses, or sub-subclasses, 

then the time-function value for each class could be based on 20 etc.) are scheduled according to per-class time -functions that 

the highest time -function value after evaluating all jobs in vary linearly with the amount of time a job in the class 

the class. All such variations are within the scope of the spends waiting for the resoxirce under a response-mode 

present invention. objective of {4:2:1 }, i.e the per-class time-function for a job 

It should be appreciated that, in usage mode, all time- is simply the "weight" for its class multiplied by the amount 

function values are positive and are moving "forward" in 25 of time it has spent waiting in the job queue. For the 

time. The scheduler mechanism thus checks for "minimum"* purposes of this simple example, assume that each job class 

values to meet the given utilization objective. Each time the has a single job which immediately returns to its job queue 

resource is used, the job class gets "charged" for it and jobs after receiving 1 unit of processing, and the waiting time of 

move forward along the given time -function value curve. In all jobs is initially 0. To be consistent with the minimum 

response mode, time-function values increase with time and 30 operator as the choice function, we consider the weights 

scheduling is typically based on selecting "maximum" val- {-4:-2:-l} for the classes A:B:C for the purposes of this 

ues (i.e. highest time-function value jobs). For purposes of simple example. Since the time-function values are initially 

a uniGed methodology, the present invention processes the all 0 (due to 0 waiting times), the scheduler will first select 

response mode time-function value curve with "negative" the job from class A for processing, since higher classes are 

weight (as will be seen below) such that, in effect, "mini- 35 preferably chosen in the case of ties. Upon completion at 

mum" values are selected just as they are during usage time 1, the time-function values for classes A, B and C are 

mode. This presents a "unified" method and processing equal to 0, -2 and -1, respectively. Since the class 2 

scheme irrespective of whether usage or response mode is time-function value is now smallest, this results in the 

involved. selection of the class B job, and upon its completion at time 

Thus, in usage mode, the scheduler checks for the mini- 40 2, the time -function values for classes A, B and C are equal 

mum value which identifies the class that is furthest away to -4, 0 and -2, respectively. The job in class A is then 

from its proportional utiUzation objective relative to the selected, and upon its completion at time 3, the per-class 

other classes at the time. In response mode, the scheduler time-function values are 0, -2, -3. This causes the job in 

checks for the largest time-function value among all jobs in class 3 to be selected next, yielding time-function values of 

the group; however, given non-decreasing functions, this 45 -4, -4 and 0 when it completes at time 4. The operation of 

simplifies to finding the largest lime-function value among the scheduler continues in this manner for this simple 

the oldest job in each class. example. A graph of this operation is shown in FIG. 93. 

The following describes representative examples of In the preferred embodiment, the proportional time- 
scheduling under usage-mode time- functions and response- function values (namely, the usage or response mode objcc- 
mode time-functions to illustrate these concepts. Consider 50 live parameters) for the job classes are adjustable. Thus, for 
the case where a pair of job classes A:B (or subclasses, or example, the vector of values is adjusted using an adaptive 
sub -subclasses, etc.) are scheduled according to a usage- feedback mechanism that "adapts" the values to changing 
mode objective of {80:20}, i.e class A is to receive 80% of conditions. A "default" set of values would then be run when 
the resource and class B is to receive 20% of the resource total system utilization was at a given value (e.g., 100%); 
over a particular interval when both jobs are present. With 55 when the total system utilization was reduced to a second 
this objective, a representative "weight" for the usage-mode value (e.g., 75%, a new set of values would be run, and so 
lime -function of class A (as described above with respect to on. Alternatively, the values for the job classes may be 
equation (1)) is {Vs} or {Yt} corresponding to a rcpresenta- changed upon the occurrence of a particular event or time of 
live "weight" for the class B usage-mode lime-function of day, or these values may be optimized or otherwise adjusted 
{Vi} or {!}. Forthepurposesof this simple example, assume 60 according to a knowledge base using an expert system. Yet 
the cumulative usage for both classes is initiaUy 0, the job another alternative is to modify the values upon a given mix 
queue for both classes contains many jobs, and the process- of jobs. Again, all such variations are within the scope of the 
ing requirements of all jobs is 1 unit. According to the present invention. 

preferred operation of the invention, the job class with the As previously noted, the present invention implements 

"minimum" time-function value is always selected when- 65 other adaptive feedback mechanisms besides adap lively 

ever a scheduling decision is made. Thus, when the resource adjusting the time-functions (or time -function parameters) 

becomes available, the scheduler will select the first job withchangesintheutilization, the mix of jobs, etc. Thus, the 
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migration of jobs from one class to another in the hierarchy hard disk drive, or in a removable memory such as an optical 

as resource usage exceeds limits specified by the system disk (for eventual use in a CD ROM) or floppy disk (for 

administrator and/or user, is another such mechanism. eventual use in a floppy disk drive), or downloaded via the 

Another such feedback mechanism involves returning to the Internet or other computer network. Thus, the present inven- 

job's base class upon not using the resource for some S lion maybe implemented as a computer program product for 

pre-specified period of time. Another adaptive feedback use in a computer. In addition, although the various methods 

mechanism addresses the problem of "priority inversion." described are conveniently implemented in a general pur- 

In particular, priority inversion is the situation where a pose computer selectively activated or reconfigured by 

high time-function value requester is blocked from using the software, one of ordinary skill in the art would also recog- 

current resource because it is also a requester for another lO nize that such methods may be carried out in hardware, in 

highly-contented resource that is held by a low time- firmware, or in more specialized apparatus constructed to 

function value requester. This can be a serious problem as perform the required method steps, 

the low value requester prevents the high time-function While the term "resource" has been used herein in relation 

requester from meeting its performance objective. This to a processor, it should be appreciated that this term should 

problem is solved using the inventive framework by allow- 15 be broadly construed to cover any physical or logical device 

ing the low time -function requester to be placed in the class or component (whether hardware or software, or some 

of the high time-function value for the duration of holding combination thereof) of a computer or computer system that 

the other highly contented resource, after which the low has some bounded capacity consumable at some given rate, 

time-function requester is returned to its original job class. Thus, a "resource" as used herein may refer, for example, to 

This is an adaptive feedback mechanism. 20 a processor (which operates at n cycles per second), a 

As a concrete example of this mechanism, assume that memory (whose storage may be reclaimed at n bits per 

there are two resources, a CPU and a logical lock. The use second), a communications link (whose capacity may be 

of CPU is scheduled using the time -function scheme. Job A allocated as a function of size and time), a database, a lock, 

is in a job class with a higher proportional usage than job B's etc. Moreover, one of ordinary skill in the art will appreciate 

class. It is assumed job B holds the lock but its Ume-function 25 that the invention may be practiced in any type of computer 

value is low in comparison to many other jobs in the system. system environment including a uniprocessor system, a 

Job A has a time-function that entitles it to have the CPU system having a group of tightly-coupled processors, or in a 

much earlier than job B, but job A is blocked from using the networked environment with a loose cluster of computers. 

CPU because of the lock held by job B. According to the Moreover, the term "job" is not intended to limit the 

present invention, job B inherits the time-function of job A's 30 invention to any particular operating system or environment, 

class for accessing the CPU imtil job B releases the lock and A "job" is analogous or equivalent to a task, a process, an 

makes it available to job A. Job B is then retumed to the job execution thread, a requester or, in general, any "unit" or 

class it was in before it was bumped up to the other class. work that consumes a resource. 

Known scheduling mechanisms do not have the capability of The present invention provides significant advantages 

solving the priority inversion problem in this unique way. 35 over the prior art. Known resource scheduling mechanisms 

The scheduler of the invention is preferably run on a do not provide an integrated framework imder which both 

computer, such as an IBM RISC System/6000 computer (a usage and response mode scheduling may be implemented, 

reduced instruction set of so-called RISC-based Even with respect to the respective modes, such known 

workstation) running the AIX Operating System (Advanced schemes do not provide for the level of control available by 

interactive Executive Version 4.1 and above), or an Intel- 40 the dynamic time-based fiinctional approach described 

based processor system running the Windows NT or 08/2® above. In addition, the present invention advantageously 

operating system. The computer includes a graphical user exploits the concept of a job class "hierarchy" wherein at 

interface (GUI) for management and administration. The one level, job classes are physically partitioned into groups 

various models of the RISC-based computers are described having absolute priority over each other and, at another 

in many publications of the IBM Corporation, for example, 45 level, individual classes are logically partitioned into a 

RISC System/60(K), 7013 and 7016 POWERstation and recursive array of subclasses. Likewise, subclasses may be 

POWERscrver Hardware Technical Reference, Order No. logically partitioned to an even finer extent. As above, 

SA23-2644-00. AIX OS is described in ADC Operating adaptive feedback mechanisms may be used to modify time 

System Technical Reference, published by IBM function values up and down the hierarchy in a dynamic 

Corporation, First Edition (November 1985), and other 50 manner. 

publications. While the above platform is uscfiil, any other These and other features of the present invention enable 

suitable hardware/operating system combinations may be the integrated methodology of this invention to address and 

used. Thus, for example, suitable alternative machines solve known scheduling problems within a new framework, 

include: an IBM-compatible PC 486 or higher running As an example, one such problem is known as "priority 

Novell UnixWare 2,0, an AT&T 3000 series running AT&T 55 inversion." 

UNIX SVR4MP-RAS Release 2.02 or greater. Data General Summarizing, the present invention provides both pro- 

AViiON series running DG/UX version 5.4R3.00 or greater, rated resource utilization (usage mode) and pro-rated 

an HP9000/700 and 800 series running HP/UX 9.00 through resource response time (response mode) within a single 

HP/UX 9.05. Motorola 88K series running SVR4 version framework. The scheduling mechanism advantageously pro- 

R40V4.2, a Sun SPARC scries running Solaris 2.3 or 2.4, or 60 vides pro-rated resource response time within categories of 

a Sun SPARC series running SunOS 4.1.2 or 4.1.3. pro-rated resource utilization, or pro-rated resource utihza- 

One of the preferred implementations of the invention is Uon within categories of pro-rated resource response time, 

an operating system utility, namely, a set of instructions Thus, for example, in the case of usage mode, multiple 

(program code) in a code module which may, for example, categories of work are allowed resource usage time in ratios 

be resident in the random access memory of the computer. 65 specified by the user or the system, such as different per- 

Until required by the computer, the set of instructions may centages for which the total equals 100 percent. Unused 

be stored in another computer memory, for example, in a cycles to which a category is entitled are allocated in 
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proportion to the ratios specified by the user In the case of 
response mode, multiple categories of work are provided 
resource response delays to achieve a general objective 
function specified by the user or the system, such as mini- 
mizing a weighted sum of a function of the pcr-class 
response times or achieving mean response delays in pre- 
defined ratios. Unused cycles to which a category is entitled 
arc allocated in proportion to the ratios ^ecifled by the user. 

The scheduling mechanism of the present invention 
makes it possible to control effectively the allocation of 
resources in a general, flexible and adaptive manner. In 
addition, various mechanisms are used to dynamically adjust 
the per-class time-functions in response to changes in the 
system workload so that the desired user or system objec- 
tives are continuously satisfied. Similarly, diverse sets of 
time -functions are employed during different periods of 
system operation to achieve the desired scheduling objec- 
tives over the corresponding time intervals. 

Having thus described our invention, what we claim as 
new and desire to secure by letters patent is set forth in the 
following claims. 

What is claimed is: 

1. A method of scheduling jobs to be executed by a 
resource in a computer system, comprising the steps of: 

organizing the jobs into a hierarchy comprising groups of 
job classes, wherein at least one group of job classes 
includes at least one job class having a set of subclasses 
associated therewith; 

proportionally allocating the resource to the hierarchy 
according to a usage objective; 

proportionally allocating the resource to the hierarchy 30 
according to a response objective; and 

scheduling job classes for execution to satisfy an objec- 
tive selected from the group of objectives consisting of 
the usage objective, the response time objective and a 
combination of the usage and response time objectives. 

2. The method as described in claim 1 wherein the usage 
objective proportionally allocates the resource to job classes 
within a given group. 

3. The method as described in claim 2 wherein the 
response objective proportionally allocates the resource to 
subclasses within a particular job class of the job classes ^° 
with the given group. 

4. The method as described in claim 1 wherein the 
response objective proportionally allocates the resource to 
job classes within a given group. 

5. The method as described in claim 4 wherein the usage 45 
objective proportionally allocates the resource to subclasses 
within a particular job class of the job classes with the given 
group. 

6. The method as described in claim 1 wherein at least a 
first group of job classes has a higher priority than a second so 
group of job classes, 

7. The method as described in claim 6 wherein the first 
group of job classes comprises job classes comprising short 
system tasks, interactive tasks and jobs with real-time con- 
straints. 55 

8. The method as described in claim 7 wherein each of the 
job classes in the first group is associated with a constant 
time-function. 

9. The method as described in claim 7 wherein each of the 
job classes in the second group of job classes is associated 
with a dynamic time -function. 

10. The method as described in claim 1 further including 
the step of modifying the response time objective, 

11. The method as described in claim 10 wherein the 
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12. The method as described in claim 1 further including 
the step of modifying the usage time objective. 

13. The method as described in claim 12 wherein the 
usage time objective is modified by adaptively adjusting 
time-function values associated with one or more job 
classes, 

14. The method as described in claim 1 further including 
the step of migrating a job between job classes of a group. 

15. The method as described in claim 14 further including 
the step of returning the job to an originating job class if the 
job does not access the resource within a given time. 

16. A method of scheduling jobs to be executed by a 
processor in a computer system, comprising the steps of: 

organizing the jobs into a hierarchy comprising job 
classes, wherein at least one job class has a set of 
subclasses associated therewith; 

proportionally allocating the processor to the hierarchy 
according to a usage objective; 

proportionally allocating the processor to the hierarchy 
according to a response objective; and 

scheduling job classes for execution to satisfy an objec- 
tive selected from the group of objectives consisting of 
the usage objective, the response time objective and a 
combination of the usage and response time objectives. 

17. The method as described in claim 16 wherein the 
usage objective proportionally allocates the processor to the 
job classes. 

18. The method as described in claim 17 wherein the 
response objective proportionally allocates the processor to 
subclasses within a particular job class. 

19. The method as described in claim 16 wherein the 
response objective proportionally allocates the processor to 
the job classes. 

20. The method as described in claim 19 wherein the 
usage objective proportionally allocates the processor to 
subclasses within a particular job class. 

21. The method as described in claim 16 further including 
the step of dynamically adjusting the response objective. 

22. The method as described in claim 16 further including 
the step of dynamically adjusting the usage objective. 

23. The method as described in claim 16 further including 
the step of selectively migrating a job between job classes, 

24. The method as described in claim 23 further including 
the step of selectively returning the job back to an originat- 
ing job class if the job does not access the resource within 
a given time. 

25. A computer, comprising: 
processor, 

an operating system, and 

a scheduler run by the operating system for scheduling 
jobs to be executed by the processor, the scheduler 
comprising: 

means for organizing the jobs into a hierarchy com- 
prising job classes, wherein at least one group of job 
classes includes at least one job class having a set of 
subclasses associated therewith; 

means for proportionally allocating the processor to the 
hierarchy according to a usage objective; 

means for proportionally allocating the processor to the 
hierarchy according to a response objective; and 

means for scheduling jobs for execution to satisfy the 
usage and response time objectives. 

26. A computer program product in a computer-readable 



response time objective is modified by adaptively adjusting 65 medium, comprising: 
time-function values associated with one or more job means for organizing the jobs into a hierarchy comprising 
classes. job classes, wherein at least one group of job classes 
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includes at least oae job class having a set of subclasses 
associated therewith; 
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means for proportionally allocating the processor to the 

hierarchy according to a usage objective; 
means for proportionally allocating the processor to the 

hierarchy according to a response objective; and 
means for scheduling jobs for execution to satisfy the 

usage and response time objectives. 

27. A method of scheduling jobs to be executed by a 
resource in a computer system, comprising the steps of: 

proportionally allocating the resource to a set of job 
classes according to a response mode objective, 
wherein each of the job classes has associated therewith 
a monotonically non-increasing time-function value; 
and 

scheduling job classes for execution to satisfy the 
response mode objective. 

28. The method as described in claim 27 wherein the 
time -function value for each job class is determined by a 20 
waiting time of an oldest job in the job class and the job 
classes are scheduled at each scheduling epoch by selecting 
a given job class having a minimum time-function value. 

29. A method of scheduling jobs to be executed by a 
resource in a computer system, comprising the steps of: 

proportionally allocating the resource to a set of job 
classes according to a usage mode objective, wherein 
each of the job classes has associated therewith a 
monotonically non-decreasing time-function value; 
and 

scheduling job classes for execution to satisfy the usage 
mode objective. 

30. The method as described in claim 29 wherein the 
time-function value for each job class is determined by an 



accumulated usage by all the jobs in the job class and the job 
classes arc scheduled at each scheduling epoch by selected 
a given job class having a minimum time -function value. 

31. A method of scheduling jobs to be executed by a 
resource in a computer system, comprising the steps of: 

proportionally allocating the resource to a set of job 
classes according to a response mode objective, 
wherein each of the job classes has associated therewith 
a monotonically non-increasing time-function value; 
proportionally allocating the resource to a set of job 
classes according to a usage mode objective, wherein 
each of the job classes has associated therewith a 
monotonically non-decreasing time-function value; 
and 

scheduling job classes for execution to satisfy the 
response mode objective, the usage mode objection, or 
a combination of the response mode and usage mode 
objectives. 

32. The method as described in claim 31 wherein the 
time-function value for each job class associated with the 
response mode objective is determined by a waiting time of 
an oldest job in the job class and the job classes are 

25 scheduled at each scheduling epoch by selected a given job 
class having a minimum time-function value. 

33. The method as described in claim 31 wherein the 
time-function value for each job class associated with the 
usage mode objective is determined by an accumulated 
usage by all the jobs in the job class and the job classes are 
scheduled at each scheduling epoch by selected a given job 
class having a minimum time -function value. 
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